BRIX - An Easy-to-Use Modular Sensor and Actuator Prototyping Toolkit

Zehe S, Großhauser T, Hermann T. BRIX - An Easy-to-Use Modular Sensor and Actuator Prototyping Toolkit. In: Tenth Annual IEEE International Conference on Pervasive Computing and Communications, Workshop Proceedings. Lugano, Swizerland: IEEE; 2012: 817-822.In this paper we present BRIX, a novel modular hardware prototyping platform for applications in mobile, wearable and stationary sensing, data streaming and feedback. The system consists of three different types of compact stack- able modules, which can adapt to various applications and scenarios. The core of BRIX is a base module that contains basic motion sensors, a processor and a wireless interface. A battery module provides power for the system and makes it a mobile device. Different types of extension modules can be stacked onto the base module to extend its scope of functions by sensors, actuators and interactive elements. BRIX allows a very intuitive, inexpensive and expeditious prototyping that does not require knowledge in electronics or hardware design. In an example application, we demonstrate how BRIX can be used to track human body movements

Multimodal Closed-loop Human Machine Interaction

Großhauser T, Hermann T. Multimodal Closed-loop Human Machine Interaction. In: Bresin R, ed. Proceedings of the 3rd International workshop on Interactive Sonification. KTH, Stockholm, Sweden: KTH School of Computer Science and Communication (CSC); 2010: 59-63.The paper presents a multi-modal approach to tightly close the interaction loop between a human user and any tool in operation. Every activity of a human being generates multi-modal feedback, more or less related to the eyes (visual), the skin (sensory), the nose (olfactory) and the ears (auditive). Here we show the useful augmentation or complete creation of a nonexistent or less available feedback. As an example the performance of drilling tasks, line drawing tasks, or the complex task of bowing a violin can be considered

Wearable Setup for Gesture and Motion based Closed Loop Audio-Haptic Interaction

Großhauser T, Hermann T. Wearable Setup for Gesture and Motion based Closed Loop Audio-Haptic Interaction. In: Brazil E, ed. Proceedings of the 16th International Community for Auditory Display. Washington, USA: International Community for Auditory Display; 2010: 31-38.The wearable sensor and feedback system presented in this paper is a type of audio-haptic display which contains on board sensors, embedded sound synthesis, external sensors, and on the feedback side a loudspeaker and several vibrating motors. The so-called "embedded sonification" in this case here is an onboard IC with implemented sound synthesis. This is adjusted directly by the user and/or controlled in real-time by the sensors, which are on the board or fixed on the human body and connected to the board via cable or radio frequency transmission. Direct audio out and tactile feedback closes the loop between the wearable board and the user. In many situations, this setup can serve as a complement to visual output, e.g. exploring data in 3D-space or learning motion and gestures in dance, sports or outdoor and every-day activities. A new metaphor for interactive acoustical augmentation is introduced, the so called "audio loupe". In this case it means the sonification of minimal movements or state changes, which can sometimes hardly be perceived visually or corporal. These are for example small jitters or deviations of predefined ideal gestures or movements. Our system is easy to use, it even allows operation without an external computer. We demonstrate and outline the benefits of our wearable interactive setup in highly skilled motion learning scenarios in dance and sports

Wearable Setup for Gesture and Motion Based Closed Loop Audio Interaction

Presented at the 16th International Conference on Auditory Display (ICAD2010) on June 9-15, 2010 in Washington, DC.The wearable sensor and feedback system presented in this paper is a type of audio-haptic display which contains onboard sensors, embedded sound synthesis, external sensors, and on the feedback side a loudspeaker and several vibrating motors. The so called “embedded sonification” in this case here is an onboard IC, with implemented sound synthesis. These are adjusted directly by the user and/or controlled in realtime by the sensors, which are on the board or fixed on the human body and connected to the board via cable or radio frequency transmission. Direct audio out and tactile feedback closes the loop between the wearable board and the user. In many situations, this setup can serve as a complement to visual output, e.g. exploring data in 3D space or learning motion and gestures in dance, sports or outdoor and every-day activities. A new metaphor for interactive acoustical augmentation is introduced, the so called “audio loupe”. In this case it means the sonification of minimal movements or state changes, which can sometimes hardly be perceived visually or corporal. This are for example small jitters or deviations of predefined ideal gestures or movements. Our system is easy to use, it even allows operation without an external computer. In some examples we outline the benefits of our wearable interactive setup in highly skilled motion learning scenarios in dance and sports

Sensor Fusion and multi-modal Feedback for musical instrument learning and teaching

Großhauser T, Hermann T. Sensor Fusion and multi-modal Feedback for musical instrument learning and teaching. In: Goebl W, ed. Proceedings of the Second Vienna Talk on Music Acoustics. Vienna: Institute of Musical Acoustics (Wiener Klangstil); 2010: 77-80.Pressure, motion, gesture and the coordination of all these parameters is an important task in musical instrument playing, exercising and teaching. New sensing and feedback technologies provide many possibilities to support the teacher and the student in the complex learning scenarios. In this paper we show with some practical examples the application of our current sensing technologies to teaching and everyday self exercising of violin. This starts from a left hand and chin pressure sensing method for coordination and position change analysis, a setup for force measurement and the weight allocation between the chin and left hand while playing, and a left and right hand thumb position and bending measurement method. Different individually adapted feedback methods allow assisted teaching in teacher-to-student tuition and also efficient training in single exercising situations at home without a teacher. But also in combination with audio, video, and gesture recording, our setup is useful for accurate offline music sheet alignment and analysis. Especially studies of complex movements as well as finger position and force distribution changes can benefit from this approach. We discuss the practical applications regarding the recognition of inaccuracy, cramping, and malposition

tacTiles: a low-cost modular tactile sensing system for floor interactions

Anlauff J, Großhauser T, Hermann T. tacTiles: a low-cost modular tactile sensing system for floor interactions. In: Proceedings of the 6th Nordic Conference on Human-Computer Interaction: Extending Boundaries. New York, NY, USA: ACM; 2010: 591-594.In this paper, we present a prototype of a spatially resolved force sensing floor surface. The force sensors are based on conductive paper and grouped into modules called tacTiles. Due to the cheap and widely available materials used for tacTiles, the approach is suitable as a low-cost alternative for spatially resolved tactile sensing. The necessary techniques are shared as an open source and open hardware project to provide an affordable tactile sensing for smart environments. As an interactive application of these tacTiles, we present a detection of step direction algorithm used to count steps into and out of a room

Supplementary Material for "Modular tacTiles for Sonic Interactions with Smart Environments"

Anlauff J, Hermann T, Großhauser T, Cooperstock J. Supplementary Material for "Modular tacTiles for Sonic Interactions with Smart Environments". Bielefeld University; 2009.<img src="https://pub.uni-bielefeld.de/download/2920033/2920034" width="250" style="float:right;" > In this paper, we present a prototype of a spatially resolved force sensing floor surface. The force sensors are based on conductive paper and grouped into modules called tacTiles. Due to the cheap and widely available materials used for tacTiles, the approach is suitable as a low-cost alternative for spatially resolved tactile sensing. The necessary techniques are shared as an open source and open hardware project to provide an affordable tactile sensing for smart environments. As an interactive application of these tacTiles, we present a detection of step direction algorithm used to count steps into and out of a room. Video of the interactive heatmap visualization and the hardware components. Video of the monitoring sonification with visualization on external LED Matrix. Video of the monitoring (step) sonification. Video of the balancing sonification. </center

Adaptive and Reactive Sensor Technology for Musical Instruments: Teaching, Exercising and Pedagogy

Großhauser T, Großekathöfer U, Hermann T. Adaptive and Reactive Sensor Technology for Musical Instruments: Teaching, Exercising and Pedagogy. In: Mornell A, ed. Art in Motion II - Motor Skills, Motivation, and Musical Practice. Frankfurt am Main, Berlin, Bern, Bruxelles, New York, Oxford, Wien: Peter Lang; 2012: 195-224

Wearable Sensor-Based Real-Time Sonification of Motion and Foot Pressure in Dance Teaching and Training

Großhauser T, Bläsing B, Spieth C, Hermann T. Wearable Sensor-Based Real-Time Sonification of Motion and Foot Pressure in Dance Teaching and Training. Journal of the Audio Engineering Society. 2012;60(7/8):580-589.As with tasks involved with motion and gesture, teaching dance can take advantage of auditory displays that map specific dance steps into their acoustic counterparts. Wearable sensors based on acoustic “fingerprints” accompany the dance movements in real-time. This kind of audio feedback has a positive influence on motor movement and perception. For example, joint angles, weight distribution, and energy of jumps are easily recognized through sound. With practice, a student can hear if a complex movement was correctly executed. The auditory system can hear complex patterns of rapid motion, especially aspects of a dance that are not easily seen